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1. Introduction 

Quantum fluctuations and competing interactions in 
quantum many body systems lead to unusual and ex- 
citing properties of strongly correlated materials such as 
quantum magnetism, 1 high temperature superconductiv- 
ity, 2 heavy fermion behavior, 3 and topological quantum 
order. 4 Although our understanding of these intriguing 
systems has grown over the past two decades, many ques- 
tions remain unanswered. Strong interactions, competi- 
tion between various ordered states, and strong thermal 
and quantum fluctuations impose limits on the applica- 
bility of mean-field theories and perturbative approaches. 
While renormalization group (RG) approaches can pre- 
dict scaling relations in these strongly correlated regimes, 
the validity for realistic microscopic models of the effec- 
tive actions used in the RG approaches can only be ver- 
ified by numerical methods. 

Direct numerical simulations of microscopic models for 
strongly correlated systems using unbiased and accurate 
algorithms are therefore of growing importance for the 
understanding of the unusual properties of these sys- 
tems. Given the challenges faced by classical many-body 
simulations, such as critical slowing down and tunnel- 
ing problems in classical Monte Carlo simulations, 5 it 
is no surprise that simulations of quantum many-body 
systems present even larger challenges. While the prob- 
lems of critical slowing down and of tunneling through 
energy barriers at first order phase transitions have been 



solved for bosonic and non-frustrated magnetic systems 
by a generalization of the classical cluster Monte Carlo 6 
and extended ensemble (broad histogram) algorithms to 
quantum systems, 7 the simulation of fermionic systems 
still presents major difficulties. Indeed, it has recently 
been shown that the negative sign problem of fermionic 
quantum Monte Carlo simulations (QMC) is NP-hard, 8 
and that a general algorithm with polynomial scaling 
most likely does not exist. The most promising approach 
therefore appears to be to improve and use a variety 
of complementary algorithms, such as exact diagonaliza- 
tion, 9 series expansion 10 or the density matrix renormal- 
ization group (DMRG) method. 11-13 

The last decade has seen tremendous progress in the 
development of algorithms. Speedups of many orders of 
magnitude have been achieved. 6,7, 12,13 These advances 
come at the cost of substantially increased algorithmic 
complexity and challenge the current model of program 
development in this research field. In contrast to other 
research areas, in which large "community codes" are 
being used, the field of strongly correlated systems has 
so far been based mostly on single codes developed by 
individual researchers for particular projects. While the 
simple algorithms used a decade ago could be easily pro- 
grammed by a beginning graduate student in a matter 
of weeks, it now takes substantially longer to master and 
implement the new algorithms. Thus, their use has in- 
creasingly become restricted to a small number of ex- 
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perts. 

2. The ALPS project 

The ALPS (Algorithms and Libraries for Physics Sim- 
ulations) project aims to overcome the problems posed 
by the growing complexity of algorithms and the spe- 
cialization of researchers onto single algorithms through 
an open-source software development initiative. Its goals 
are to provide: 

• standardized file formats to simplify exchange, 
distribution and archiving of simulation results and 
to achieve interoperability between codes. 

• generic and optimized libraries for common as- 
pects of simulations of quantum and classical lattice 
models, to simplify code development. 

• a set of applications covering the major algo- 
rithms. 

• license conditions that encourage researchers to 
contribute to the ALPS project by gaining scientific 
credit for use of their work. 

• outreach through a web page, 1 mailing lists and 
workshops to distribute the results and to educate 
researchers both about the algorithms and the use 
of the applications. 

• improved reproducibility of numerical results by 
publishing source codes used to obtain published re- 
sults. 

• an archive for simulation results. 

The ready-to-use applications are useful both for theo- 
reticians who want to test theoretical ideas about quan- 
tum lattice models and to explore their properties, as well 
as for experimentalists trying to fit experimental data to 
theoretical models to obtain information about the mi- 
croscopic properties of materials. 

In contrast to other fields, in which open-source devel- 
opment efforts began decades ago, starting now allows 
us to build our design directly on recent developments in 
computer science, in particular: 

• XML 15 (extensible Markup Language) and HDF5 16 
(Hierarchical Data Format version 5), portable data 
formats supported by a large number of standard 
tools 

• generic and object oriented programming in C++ 
to achieve flexible but still optimal codes 

• OpenMP 17 and MPI 18 for parallelization on shared 
memory machines and Beowulf clusters 

In the following, we present additional details about 
these various aspects of the ALPS project. 

3. File formats 

The most basic part of the ALPS project is the defi- 
nition of common standardized file formats suitable for 
a wide range of applications. Standardized file formats 
enable the exchange of data between applications, allow 
the development of common evaluation tools, simplify 
the application of more than one algorithm to a given 
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<PARAMETERS> 

PARAMETER name= " LATTI CE " > square </PARAMETER> 
PARAMETER name="MODEL"> spin </PARAMETER> 

PARAMETER name="L"> 10 </PARAMETER> 

PARAMETER name="T"> 0.5 </PARAMETER> 

</PARAMETERS> 

Fig. 1. Excerpt from an XML file for simulation input parame- 
ters. 

<SCALAR_ AVERAGE name="Susceptibility"> 
<MEAN> 421.3 </MEAN> 

<ERR0R converged="yes"> 1.54 </ERR0R> 

<VARIANCE> 1.06e+05 </VARIANCE> 

</SCALAR_AVERAGE> 

Fig. 2. Excerpt from an XML file for simulation results of the 
uniform susceptibility in a Monte Carlo simulation. 

model, and are a prerequisite for the storage of simula- 
tion data in a common archive. 

We have designed a number of XML schemas 19 to de- 
scribe the input of simulation parameters, the output of 
results, and the specification of lattices and quantum lat- 
tice models. The ISO standard XML was chosen for the 
specification because it has become the main text-based 
data format on the internet and because it is supported 
by a large and growing number of tools. Unlike simple 
formats, in which the location of an argument in the file 
specifies its meaning (e.g. the first line specifies the sys- 
tem size, the second line temperature), XML specifies the 
meaning of data through meta-information provided by 
markup with tags, as shown in figure I for input param- 
eters and figure 2 for simulation results. The meaning of 
these files is easy to decipher even years after comple- 
tion of the simulation, unlike many other formats. The 
resemblance to HTML is not accidental; in fact, HTML 
(XHTML) is also an XML format. 

In addition to XML schemas for parameter input and 
for output of results, we have developed schemas for the 
description of lattices and models. Examples are shown 
in figures 3 and 4. A detailed specification of the formats 
is given on our XML web page. 19 

Any of the ALPS applications can be run by providing 
an input file (such as the one which is excerpted in figure 
I), together with lattice and model definitions (figures 
3 and 4) to that application (provided the application 
supports that type of model). The application then re- 
turns an output file containing data such as that shown 
in figure 2. Standardized formats that extend across all 
applications reduce the learning curve for using the ap- 
plications and allow common tools to be used to analyze 
the data. 

In order to avoid working directly with the long (and 
sometimes ugly) output files in XML format, the XML 
files can be easily transformed to other formats using 
XSLT transformations 20 and can be viewed, for example, 
directly as HTML in a web browser, printed as plain text, 
converted to L^TjtX, or displayed as a plot in one of a 
number of common plotting programs. 21 

In addition to these text-based XML formats, the 
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<LATTICEGRAPH name = " square "> 
<FINITELATTICE> 

<LATTICE dimension="2"/> 

<EXTENT dimension="l" size="L"/> 

<EXTENT dimension="2" size="L"/> 

<B0UNDARY type= M periodic"/> 
</FINITELATTICE> 
<UNITCELL> 

<VERTEX/> 

<EDGE> 

<S0URCE vertex="l" offset="0 0"/> 
<TARGET vertex="l" offset="0 l"/> 

</EDGE> 

<EDGE> 

<S0URCE vertex="l" offset="0 0"/> 
<TARGET vertex="l" offset="l 0"/> 
</EDGE> 
</UNITCELL> 
</LATTICEGRAPH> 

Fig. 3. The definition of a square lattice with one site (vertex) 
per unit cell and bonds (edges) only to nearest neighbors. First 
the dimension, extent, and boundary conditions of the Bravais 
lattice are described in the <FINITELATTTCE> element, then the 
unit cell including the bonds in the lattice is defined. 



<BASIS name="spin"> 
<SITEBASIS> 

<QUANTUMNUMBER name="S" min="l/2" max="l/2"/> 
<QUANTUMNUMBER name="Sz" min="-S" max="S"/> 
<0PERAT0R name=" Spins" 

matrixelement="sqrt(S*(S+l)-Sz*(Sz+l)) "> 
<CHANGE quantumnumber="Sz" change="l"/> 
</0PERAT0R> 

<0PERAT0R name="Sminus" 

matrixelement="sqrt(S*(S+l)-Sz*(Sz-l)) "> 
<CHANGE quantumnumber="Sz" change="-l"/> 
</0PERAT0R> 

<0PERAT0R name="Sz" matrixelement="Sz"/> 
</SITEBASIS> 
</BASIS> 

<HAMILTONIAN name="spin"> 
<BASIS ref="spin"/> 
<SITETERM> -h*Sz </SITETERM> 
<B0NDTERM source="i" target="j"> 

Jxy/2* (Splus (i) *Sminus ( j ) +Sminus (i) *Splus ( j ) ) 
+ Jz*Sz(i)*Sz(j) 
</B0NDTERM> 
</HAMILTONIAN> 

Fig. 4. The definition of a spin-1/2 XXZ spin Hamiltonian 
with one type of exchange coupling only: H = —h'}2 i S* + 
((Jxy/2)(5+5- + 5"5+) + J Z S*S*). After describing 
the local basis for each site and operators acting on it, the Hamil- 
tonian is defined. 

ALPS libraries support portable binary formats for large 
data sets such as time series of Monte Carlo simulations. 
These data sets are currently stored in XDR format, the 
standard Unix format for remote procedure calls and se- 
rialization, but plans are afoot to switch to the better- 
supported HDF5 format 16 in the near future. 
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Fig. 5. Hierarchical structure of the components of the ALPS 
project. The red frame encloses components developed as part 
of the ALPS project. Libraries outside the frame are publicly 
available high-performance libraries that can be obtained from 
the Boost 25 web page or the netlib repository. 26 

4. Libraries 

The ALPS libraries are the foundation of all the ALPS 
applications, providing functionality common to all of 
them: 

• an XML parser and output stream to read and write 
the ALPS XML files. 

• an expression library to manipulate and evaluate 
symbolic expressions. 

• a scheduler for the automatic parallelization of 
Monte Carlo simulations and other "embarrass- 
ingly" parallel applications, implementing load bal- 
ancing and checkpointing. 22 

• a lattice structure library for the creation of arbi- 
trary graphs and Bravais lattices from XML input. 

• a model library for the construction of basis sets, 
operators, and Hamiltonians from XML input. 

• the "alea" library for the statistical analysis and 
evaluation of Monte Carlo data including a binning 
analysis of errors and jackknife analysis of cross- 
correlations. 22 

• a serialization library "osiris" for the serialization 
of C++ data structures, used for writing program 
checkpoints and portable binary result files. 22 

These libraries make full use of object-oriented and 
generic programming techniques, 23 which allows them 
to be very flexible without losing any performance com- 
pared to FORTRAN programs. To give just one example, 
the lattice library, which is implemented generically using 
C++ template features and is based on the Boost Graph 
Library 24 ' 25 (BGL), does not restrict the user to a spe- 
cific data structure as in C or Fortran libraries. Instead, 
the application programmer can choose the data struc- 
ture best suited for the application. As long as this data 
structure provides the BGL graph interface, the ALPS 
lattice library can construct the lattice from the XML 
description. 

Figure 5 shows a diagrammatic overview of the hier- 
archy of components in the ALPS project: the ALPS 
applications (discussed in the next section) are based 
on domain-specific ALPS libraries, such as the lattice, 
model, alea, or the scheduler library. These libraries are 
based on numerical and general C++ libraries, devel- 
oped either in ALPS or in the C++ Boost project. 25 In 
addition to the BGL mentioned above, the external li- 
braries include the Boost random number library, which 
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has been accepted into the next release of the C++ 
standard as a standard library, and the Boost uBLAS 
library for matrix and vector operations. A numerical li- 
brary developed by us and distributed with the ALPS 
software, the Iterative Eigensolver Template Library 27 
(IETL), provides a package of iterative eigensolvers for 
sparse matrices. Finally, the lowest level of the hierarchy 
is a set of common C and FORTRAN libraries, includ- 
ing the high performance BLAS and LAPACK libraries 
for linear algebra and the MPI and PVM libraries for 
communication on distributed systems. 

5. Applications 

The following application programs, based on the 
above libraries, are implemented in release 1.2: 

• a Monte Carlo program for classical magnets em- 
ploying cluster algorithms. 28 

• the QMC program "looper" using the loop clus- 
ter algorithm 6 ' 29 in a stochastic series expansion 30 
(SSE) and path-integral representation for quantum 
magnets with spin reversal symmetry. 

• an optimized directed loop QMC program 31 in an 
SSE representation for bosonic and magnetic quan- 
tum lattice models. 

• a worm algorithm 32 QMC program best suited for 
bosonic quantum lattice models and easy-axis quan- 
tum magnets. 

• an extended ensemble QMC program using a gener- 
alization of the Wang-Landau 33 algorithm to quan- 
tum systems, 7 to obtain thermodynamic quantities 
over large temperature ranges. 

• an exact diagonalization program which can calcu- 
late the ground state and low lying excited states 
of quantum lattice models using the Lanczos 34 algo- 
rithm. 

• a full diagonalization program which can calcu- 
late the complete eigenspectrum of quantum lattice 
models and from it all thermodynamic properties. 

• a DMRG 11 program for noninteracting particles. 
This is an adaptation of the program in Refs. 13 ' 35 
to the ALPS libraries. In addition to demonstrating 
the fundamental ideas of the DMRG, it solves one- 
dimensional single-particle quantum problems in ar- 
bitrary potentials. 

Planned for the future are: 

• support for lattice symmetries in the exact and full 
diagonalization codes in release 1.3. 

• a DMRG 11-13 code for static properties in release 
1.3. 

• a series expansion 10 code for both perturbation se- 
ries and high temperature series. 

• a determinental QMC 36 code for two- and three- 
dimensional fermionic models. 

• a toolset for mean- field calculations on quantum lat- 
tice models. 

These applications comprise the most important un- 
biased algorithms for quantum many body systems. The 



implementations all share the same file formats, simplify- 
ing their use, reducing the learning curve, and enabling 
the easy investigation of a model with more than one 
method. Tutorials on the use of the applications are in- 
cluded with the sources that can be found on the ALPS 
web page. 14 

These codes and libraries have already been used in a 
number of publications, of which we will mention only 
a small representative sample illustrating the breadth of 
possible applications. The exact diagonalization library 
was used in the investigation of quantum bits with topo- 
logical protection. 37 Anisotropic quasi-one dimensional 
and quasi-two dimensional quantum magnets were in- 
vestigated recently using the "looper" QMC program. 38 
A precursor of the looper program was used for exten- 
sive fits of QMC simulations to experimental measure- 
ments 39,40 and to determine phase diagrams critical ex- 
ponents of quantum phase transitions 41 and universal 
critical temperatures of quantum critical magnets in a 
field. 42 A precursor of the directed loop program based 
on the ALPS libraries has been used to determine ground 
state and finite-temperature phase diagrams of hard-core 
bosons. 43 The optimized directed loop and worm algo- 
rithm QMC programs were applied to determine proper- 
ties of ultra-cold bosonic atoms in optical lattices 44 and 
to calculate magnetization curves of spin systems. 45 The 
ALPS libraries were also employed recently in simula- 
tions of dissipative quantum phase transitions, 46 in a 
spin- wave analysis of quantum magnetic quasicrystals, 47 
and in a multi-scale approach to the simulation of nano- 
magnets. 48 

6. License and Motivations to Contribute 

The ALPS library 49 and application 50 licenses were 
designed by LP. McCulloch after extensive discussions 
inside the ALPS collaboration. They are based on the 
GNU general public license. 51 The use of the libraries 
and codes is free but carries a citation requirement to 
publications describing the libraries and codes. 

Stricter licensing terms, such as the requirement to 
submit any modifications and improvements of the codes 
to the ALPS collaboration, or a requirement to publish 
any codes built on the ALPS libraries or applications as 
a supplement to the paper presenting the results, were 
discussed but have not been included in the license at the 
present time. We feel, however, that the idea of publish- 
ing source code of numerical simulations together with 
the scientific results produced could be very beneficial 
by enabling reproducibility of numerical simulations. We 
encourage a wider discussion on this question in the com- 
putational physics community. 

Besides "payment" in the scientific currency of cita- 
tions, and peer pressure to contribute after profiting from 
the ALPS project, additional motivations (especially for 
junior researchers) to contribute to the ALPS project are 
networking opportunities and many chances to start new 
research collaborations based on codes contributed to the 
ALPS project. 
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7. Outreach and Development 

The ALPS web page 14 is the central information repos- 
itory of the ALPS collaboration. It makes source codes of 
the ALPS libraries and applications available, provides 
access to the documentation, and distributes information 
about the mailing lists, new releases, and workshops. 

We intend to provide extensive tutorials with hands- 
on sessions using the ALPS applications at workshops on 
numerical simulations of quantum lattice models at least 
once per year. Such tutorials have thus far been held on 
three occasions: a workshop on Wang-Landau sampling 
for classical and quantum systems at Oak Ridge National 
Labs in August 2003, a graduate lecture series at the 
University of Hannover, Germany in November 2003, and 
a workshop on simulation tools in Lugano, Switzerland 
in September 20 04. 52 More tutorials are planned for 2005 
and 2006. 

The ALPS project has been further publicized by 
talks, such as an invited talk by S. Trebst at the 2004 
March Meeting of the American Physical Society, 53 a 
presentation at the DMRG workshop at the Lorentz cen- 
ter in Leiden, 54 and poster presentations at various con- 
ferences. 

Development of the ALPS libraries and applications is 
coordinated through both mailing lists and semi-annual 
developer workshops. These ALPS developer workshops 
(all held in alpine regions so far) have been instrumental 
not only in planning development efforts for the subse- 
quent half year, but also in providing important devel- 
opment deadlines - and thus counter the susceptibility 
of all software projects to interminable delays. 

8. Future plans 

The ALPS project is continuously evolving; many im- 
provements and additions are planned for forthcoming 
releases. Planned near-term improvements, in addition 
to those mentioned in section 5 will be the capability of 
specifying arbitrary measurements of local operators and 
correlation functions in input files. 

A major future development effort will be to establish 
a database and archive for simulation results based on 
our proposed XML formats. Whereas today simulation 
results are usually published only in the form of figures 
or fit results after much data processing, the archive will 
allow the easy retrieval of detailed results in a unified 
format. Current research on data and storage grids as 
well as the rapid progress in the development of XML- 
based databases and tools will surely prove helpful for 
this project. 

In a further stage, we envision expanding the ALPS 
project in the long term to include dynamical mean field 
theory (DMFT) codes 55 as well as interfacing the ALPS 
applications to band structure codes, thus making it pos- 
sible to obtain a microscopic lattice model from ab-initio 
calculations. These efforts will be coordinated with the 
ip-M&g project at Oak Ridge National Laboratory, which 
aims at unifying the interface of band structure codes and 
at combining them with classical spin dynamics simula- 
tions for nanomagnetics. 56 

In addition to these coordinated development ef- 



forts, we offer a repository for other open source sim- 
ulation codes on our computational physics web page 
http : //www . comp-phys . org/. 

9. Conclusions 

The ALPS project is an open source effort at provid- 
ing libraries and applications for the simulation of classi- 
cal and quantum lattice models. Common XML file for- 
mats enable the sharing and archiving of simulation data. 
Generic and optimized libraries simplify the development 
of simulation codes by implementing common tasks such 
as I/O and the construction of lattice and model data 
structures. The ALPS applications make modern high- 
performance numerical algorithms available to a wider 
range of researchers. They enable theoreticians to investi- 
gate properties of interesting strongly correlated models 
conveniently, and allow experimentalists to perform di- 
rect comparisons and fits of experimental measurements 
to numerical simulations. 

Researchers interested in announcements of new re- 
leases, information about workshops, or in contributing 
to the ALPS project are encouraged to sign up to the 
mailing lists on our web page. 14 
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